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DETAILED ACTION 
Response to Arguments 

1 . Applicants arguments filed 09 October 2007 have been fully considered but they 
are not persuasive. Applicant argues that key elements of the claims are an. array 
controller which simultaneously reads out a 2x2 pixel block, "which need not be a Bayer 
matrix" from adjacent columns and arrays. However, this limitation is nowhere to be 
found in the claims as written. Therefore, any arguments based on this limitation are 
considered moot since the limitation does not appear in the current claims. Although 
the claims are interpreted in light of the specification, limitations from the specification 
are not read into the claims. See In re Van Geuns, 988 F.2d 1181, 26 USPQ2d 1057 
(Fed. Cir. 1993). 

Claim Rejections - 35 (JSC § 103 

2. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 1, 3, 4, 6, 12-22, 26, 28, 29, 31, 33, 35, 36, 39 and 40 are rejected under 
35 U.S.C. 103(a) as being unpatentable over Hashimoto (US 4,768,085) in view of 
Ogawa et al. (US 7,142,233) in view of Roberts (5,541 ,654). 

[claim 1] 

In regard to claim 1, note that Hashimoto discloses a color imaging system for 
compensating a color response comprising: an array of pixel sensor elements (e.g. 
Figure 1); a color filter including a plurality of color filter components organized in a 
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predefined pattern, the color filter overlaying at least a portion of the array, wherein the 
pixel sensor elennents include at least one element associated with a first color filter 
component, at least one element associated with a second color component and at 
least one element associated with a third color component (e.g. Figure 1; c. 3, II. 37-47); 
a first and second analog compensation unit coupled to at least one element associated 
with the first and second color filter components, respectively, the analog compensation 
units adapted to modify a readout of at least one element associated with the respective 
color component (Figure 5, Items 4 and 5; c. 4, II. 55-59); an analog summer (i.e. 
summing amplifier) coupled to two elements associated with the third color filter 
component and outputting an analog sum of the two elements (Figure 2, Item 2a3; 
Figure 5); a third analog compensation unit coupled to at least one element associated 
with the first and second color filter components, respectively, the analog compensation 
units adapted to modify a readout of at least one element associated with the respective 
color component (Figure 5. Item 3; c. 4, II. 55-59); and an array controller (Figure 1, 
Items 2a1 , 2a2). Hashimoto further discloses simultaneous readout of two horizontal 
lines, but does not explicitly disclose simultaneous readout of a 2x2 block. 

Ogawa discloses an image sensor which reads out pixel signals in units of blocks 
(i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa further 
discloses that this manner of readout the basic blocks necessary for interpolation 
processing are available and an interpolated signal for an arbitrarily read region can be 
obtained at random (c. 7, II. 39-50). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to perform readout in units of 



Application/Control Number: Page 4 

09/495,971 

Art Unit: 2622 

blocks as taught by Ogawa in the image sensor of Hashimoto in order to allow for 
interpolated signals of arbitrary regions to be obtained at random. However, Hashimoto 
in view of Ogawa lacks readout of components in a selected window of the array while 
other sections of the array are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the array 
(Figure 6, Items 172 or 174) are readout independently from the rest of the array. 
Roberts further discloses that the rest of the array may not be read out (i.e. processed) 
while the window may be scanned at a frame rate much higher than if the entire array 
were to be read out (c. 10, II. 9-21). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to implement a windowing 
operation in the device of Hashimoto in order to achieve higher frame rates by reading 
out (i.e. processing) only a subset of the entire array. The examiner notes that Roberts 
discloses the use of a control circuit 32 and decoding and latching circuits 22 and 24 (c. 
4, 11.20-41). 
[claim 3] 

In regard to claim 3, note that Hashimoto discloses an array which is arranged in 
a plurality of rows and columns (e.g. Figure 1). 
[claim 4] 

In regard to claim 4, note that Hashimoto discloses an array controller adapted to 
control readout of a plurality of pixel sensor elements in parallel (c.4, II. 5-15). 
[claim 6] 
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In regard to claim 6, note that Hashimoto discloses analog compensation units 
which are gain amplifiers (c.4, II. 55-59). 
[claim 12] 

In regard to claim 12, note that Hashimoto discloses color filter components 
including the colors of red, blue and green (Figure 1; c. 3, II. 37-47). 
[claims 13 and 14] 

In regard to claims 13 and 14, Hashimoto discloses all limitations except for the 
interlaced or odd and even readout modes of columns and rows. However, the use of 
independent readout of even and odd rows or columns is well known in the art to create 
industry standard NTSC TV signals or to reduce the amount of data readout during for a 
frame when a high frame rate is more important than high resolution. Therefore, It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to use even and odd row or column readout with the imaging system of 
Hashimoto to create NtSC TV signals or to reduce the resolution in order to achieve 
higher frame rates, 
[claim 15] 

In regard to claim 15, note that Ogawa discloses an array controller which 
causes a plurality of substantially simultaneous, independent readouts for a plurality of 
rows and some columns (Figure 4; c. 3, II. 57-59). 
[claims 16 and 19] 

In regard to claims 16 and 19, Hashimoto discloses all limitations except for a 
passive CCD imaging device. However, the use of CCD imagers in cameras is well 
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known in the art to provide higher sensitivity than other imagers, such as CMOS 
imagers (Official Notice). Therefore, It would have been obvious to one of ordinary skill 
in the art at the time the invention was made to use a passive CCD imager as the 
imaging device of Hashimoto to achieve higher sensitivity, 
[claims 17 and 18] 

In regard to claims 17 and 18, Hashimoto discloses all limitations except for an 
active CMOS imaging sensor device. However, it is well known in the art to use active 
CMOS image sensors in applications where nondestructive readout of pixels is 
required, such as in Hashimoto (e.g. c. 3, II. 48-52). Therefore, It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to use an 
active CMOS image sensor in the imaging system of Hashimoto to allow for non- 
destructive readout of the image sensor (Official Notice), 
[claim 20] 

In regard to claim 20, note that at least a first pixel sensor element of Hashimoto 
is associated with a different color than a second, neighboring pixel sensor element 
(Figure 1). 
[claim 21] 

In regard to claim 21, note that Hashimoto discloses all limitations except for 
color components organized in a Bayer color pattern. However, the use of the Bayer 
color pattern is well known in the art for its ability to provide a greater amount of 
luminance data than chrominance data in a way similar to human vision (e.g. US 
3,971 ,065). Therefore, It would have been obvious to one of ordinary skill in the art at 
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the time the invention was made to use a Bayer color filter to more closely mimic human 
vision (Official Notice), 
[claim 22] 

In regard to claim 22, note that Hashimoto discloses all limitations except for a 
complementary color scheme include yellow, cyan and magenta color filters. However, 
the use of yellow, cyan and magenta is a well known design alternative to the use of 
red, green and blue color filters as is well known in the art. Therefore, It would have 
been obvious to one of ordinary skill in the art jat the time the invention was made to use 
yellow, cyan and magenta color filters to achieve color images (Official Notice), 
[claim 26] 

In regard to claim 26, note that Hashimoto discloses a method of compensating 
color response in an analog domain of an array of pixel sensor elements comprising: 
amplifying an analog output from a plurality of elements of a first color component 
(Figure 5, Item 4; c. 4, II. 55-59); amplifying an analog output from a plurality of 
elements of a second color component wherein two said elements outputs are summed 
together prior to the amplifying (Figure 5, Item 3 and (G1+G2); c. 4, II. 55-59; c. 5, II. 49- 
60); and generating a compensated analog readout of the plurality of elements of the 
first color component (Figure 5) , Hashimoto further discloses simultaneous readout of 
two horizontal lines, but does not explicitly disclose simultaneous readout of a 2x2 
block. 

Ogawa discloses an image sensor which reads out pixel signals in units of blocks 
(i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa further 
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discloses that this manner of readout the basic blocks necessary for interpolation 
processing are available and an interpolated signal for an arbitrarily read region can be 
obtained at random (c. 7, II. 39-50). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to perform readout in units of 
blocks as taught by Ogawa in the image sensor of Hashimoto in order to allow for 
interpolated signals of arbitrary regions to be obtained at random. However, Hashimoto 
in view of Ogawa lacks readout of components in a selected window of the array while 
other sections of the array are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the array 
(Figure 6, Items 172 or 174) are readout independently from the rest of the array. 
Roberts further discloses that the rest of the array may not be read out (i.e. processed) 
while the window may be scanned at a frame rate much higher than if the entire array 
were to be read out (c. 10, II. 9-21). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to implement a windowing 
operation in the device of Hashimoto in order to achieve higher frame rates by reading 
out (i.e. processing) only a subset of the entire array. The examiner notes that Roberts 
discloses the use of a control circuit 32 and decoding and latching circuits 22 and 24 (c. 
4, II. 20-41). 
[claim 28] 

In regard to claim 28, note that Hashimoto discloses generating a compensated 
analog readout comprising amplifying the analog readout for the plurality of elements of 
the first color component with a first programmable gain amplifier (i.e. white balance 
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amplifier; c.4, II. 55-59; The office notes that the system of figure 5 would inherently 
include such a white balance controller to allow for proper white balance, even though 
such a controller is not depicted), 
[claim 29] 

In regard to claim 29, note that Hashimoto discloses white balancing the first 
color component (i.e. determining an optical level of color compensation for the analog 
readout of the plurality of elements of the first color component; c. 4; II. 55-59). 
[claim 31] 

In regard to claim 31 , note that the Hashimoto discloses sensor elements that are 
associated with the colors of red, blue and green (Figure 1; c. 3, II. 37-47). 
[claim 33] 

In regard to claim 33, note that Ogawa discloses an act of generating comprising 
generating a plurality of substantially simultaneous, independent readouts for the set of 
rows and the set of columns (Figure 4; c. 3, II. 57-59). 
[claim 35] 

In regard to claim 35, note that Hashimoto discloses a color imaging system for 
compensating a color response comprising: an array of pixel sensor elements (e.g. 
Figure 1); a color filter including a plurality of color filter components organized in a 
predefined pattern, the color filter overlaying at least a portion of the array, wherein the 
pixel sensor elements include at least one element associated with a first color filter 
component, at least one element associated with a second color component and at 
least one element associated with a third color component (e.g. Figure 1; c. 3, II. 37-47); 
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a first and second analog connpensation unit coupled to at least one element associated 
with the first and second color filter components, respectively, the analog compensation 
units adapted to modify a readout of at least one element associated with the respective 
color component (Figure 5, Items 4 and 5; c. 4, II. 55-59); an analog summer (i.e. 
summing amplifier) coupled to two elements associated with the third color filter 
component and outputting an analog sum of the two elements (Figure 2, Item 2a3; 
Figure 5); a third analog compensation unit coupled to at least one element associated 
with the first and second color filter components, respectively, the analog compensation 
units adapted to modify a readout of at least one element associated with the respective 
color component (Figure 5, Item 3; c. 4, II. 55-59); and an array controller which 
selectively couples elements associated with the first, second and third colors to the 
first, second and third amplifiers respectively (Figure 2; Figure 5; note the individual 
colors connected to individual amplifiers). Hashimoto further discloses simultaneous 
readout of two horizontal lines, but does not explicitly disclose simultaneous readout of 
a 2x2 block. 

Ogawa discloses an image sensor which reads out pixel signals in units of blocks 
(i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa further 
discloses that this manner of readout the basic blocks necessary for interpolation 
processing are available and an interpolated signal for an arbitrarily read region can be 
obtained at random (c. 7, II. 39-50). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to perform readout in units of 
blocks as taught by Ogawa in the image sensor of Hashimoto in order to allow for 
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interpolated signals of arbitrary regions to be obtained at random. However, Hashimoto 
in view of Ogawa lacks readout of components in a selected window of the array while 
other sections of the array are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the array 
(Figure 6, Items 172 or 174) are readout independently from the rest of the array. 
Roberts further discloses that the rest of the array may not be read out (i.e. processed) 
while the window may be scanned at a frame rate much higher than if the entire array 
were to be read out (c. 10, II. 9-21). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to implement a windowing 
operation in the device of Hashimoto in order to achieve higher frame rates by reading 
out (i.e. processing) only a subset of the entire array. The examiner notes that Roberts ^ 
discloses the use of a control circuit 32 and decoding and latching circuits 22 and 24 (c. 
4, II. 20-41). Roberts further discloses the use of the control circuit to perform 
windowing by resetting and reading of pixels under variable patterns (c. 7, II. 33-45). 
[claim 36] 

In regard to claim 36, note that Hashimoto discloses sensor elements arranged in 
rows and columns (Figure 1). 
[claim 39] 

In regard to claim 39, note that Hashimoto discloses a method of interpolating a 
color value in the analog domain in real-time, comprising: modifying a first analog signal 
corresponding to the output of a first pixel element in an imager to color correct the first 
pixel, wherein the first pixel element is used to sense light intensity of a first color (e.g. 
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Figure 5, Item 4; c. 4, II. 55-59); and modifying a second analog signal corresponding to 
the output of a second and a third pixel element in an imager to color correct the second 
and third pixels, wherein the second and third pixels are used to sense light intensity of 
a second color and wherein the second analog signal is a sum of the second a third 
pixel elements (Figure 5, Item 3; c. 4, II. 55-59; The office notes that the system of 
Hashimoto modifies the analog signals by white balancing them). Hashimoto further 
discloses simultaneous readout of two horizontal lines, but does not explicitly disclose 
simultaneous readout of a 2x2 block. 

Ogawa discloses an image sensor which reads out pixel signals in units of blocks 
(i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa further 
discloses that this manner of readout the basic blocks necessary for interpolation 
processing are available and an interpolated signal for an arbitrarily read region can be 
obtained at random (c. 7, II. 39-50). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to perform readout in units of 
blocks as taught by Ogawa in the image sensor of Hashimoto in order to allow for 
interpolated signals of arbitrary regions to be obtained at random. However, Hashimoto 
in view of Ogawa lacks readout of components in a selected window of the array while 
other sections of the array are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the array 
(Figure 6, Items 172 or 174) are readout independently from the rest of the array. 
Roberts further discloses that the rest of the array may not be read out (i.e. processed) 
while the window may be scanned at a frame rate much higher than if the entire array 
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were to be read out (c. 10, II. 9-21). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to implement a windowing 
operation in the device of Hashimoto in order to achieve higher frame rates by reading 
out (i.e. processing) only a subset of the entire array. The examiner notes that Roberts 
discloses the use of a control circuit 32 and decoding and latching circuits 22 and 24 (c. 
4, II. 20-41). 
[claim 40] 

In regard to claim 40, note that Hashimoto discloses modifying a third analog 
signal corresponding to the output of a third pixel element in the imager to color correct 
the third pixel (Figure 5, Item 5; c. 4, II. 55-59) 

4. Claims 7, 8, 30 and 32 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hashimoto (US 4,768,085) in view of Ogawa et al. (US 7,142.233) in 
view of Roberts (US 5,541,654) as applied to claim 1 above, and in further view of 
Boisvert et al. (US 5,329,312). 
[claim 7] 

In regard to claim 7, note that Hashimoto in view of Ogawa in view of 
Robertsdiscloses all limitations except for analog compensation units which are 
programmable gain amplifiers. Boisvert et al. teaches an improved analog signal 
processing system which provides white balancing with minimal dark level differences 
(e.g. c. 5, II. 7-29) using separate programmable gain amplifiers for each pixel color 
(e.g. Figure 1; Figure 2; c. 6, II. 14-45). Therefore, it would have been obvious to one of 
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ordinary skill in the art at the time the invention was made to use the programmable 
gain amplifiers of Boisvert et al. in the white balance system of Hashimoto to reduce the 
amount of dark level differences between the colors, 
[claim 8] 

In regard to claim 8, see claim 7. 
[claim 30] 

In regard to claim 30, note that Hashimoto in view of Ogawa in view of Roberts 
discloses all limitations except for a compensated analog readout that depends on a 
temperature of the system. Boisvert et al. teaches an improved analog signal 
processing system which provides white balancing with minimal dark level differences 
(e.g. c. 5, II. 7-29) using separate programmable gain amplifiers for each pixel color 
(e.g. Figure 1; Figure 2; c. 6, II. 14-45). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to use the programmable 
gain amplifiers of Boisvert et al. in the white balance system of Hashimoto to reduce the 
amount of dark level differences between the colors. It is further noted that the analog 
signal processors of Boisvert et al. are temperature compensated (i.e. the readout 
depends on temperature of the system; c. 13, 11. 20-24). 
[claim 32] 

In regard to claim 32, note that Hashimoto in view of Ogawa discloses an act of 
generating comprising: generating an independent readout for even numbered rows (i.e. 
Figure 2, Items G2 and B2); generating an independent readout for odd numbered rows 
(i.e. Figure 2, Items G1 and R1); generating an independent readout for even numbered 



Application/Control Number: Page 15 

09/495,971 

Art Unit: 2622 

columns (i.e. Figure 2, Items R1 and B2); and generating an independent readout for 
odd numbered columns (i.e. Figure 1, Items G1 and G2; The office notes that each of 
the pixel elements G1, B1, 02 and R2 are readout independently (i.e. on independent 
readout lines) from each other which meets the limitation of the claims, such that at 
least one element associated with red, blue and green filter components are coupled to 
first, second and third gain amplifiers respectively (Figure 5). Therefore, it can be seen 
that Hashimoto lacks programmable gain amplifiers for each color component. 

Boisvert et al. teaches an improved analog signal processing system which 
provides white balancing with minimal dark level differences (e.g. c. 5, II. 7-29) using 
separate programmable gain amplifiers for each pixel color (e.g. Figure 1; Figure 2; c. 6, 
II. 14-45). Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to use the programmable gain amplifiers of Boisvert et al. 
in the white balance system of Hashimoto to reduce the amount of dark level 
differences between the colors. 

5. Claim 9 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hashimoto (US 4,768,085) in view of Ogawa et al. (US 7,142,233) in view of Roberts 
(US 5,541,654) in view of Boisvert et al. (US 5.329,312) as applied to claim 7 above, 
and in further view of Zhou et al. (IEEE), 
[claims 9 and 10] 

In regard to claims 9 and 10 it can be seen that Hashimoto in view of Ogawa in 
view of Roberts in view of Boisvert disclose all limitations except for programmable gain 
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amplifiers contained within the pixel circuitry and within a plurality of column buffers. 
However, such a system is well known in the art, (for example see Zhou, Figures 1 and 
2) as a way to reduce the overall size of imaging systems. Therefore, It would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
alter the design of Boisvert with the gain amplifiers of Zhou contained in the pixel 
circuitry of the array in a plurality of column buffers to reduce the overall size. 

6. Claim 23 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hashimoto (US 4,768,085) in view of Ogawa et al. (US 7,142,233) in view of Roberts 
(US 5,541,654) as applied to claim 1 above, and in further Sano et al. (IEEE), 
[claim 23] 

In regard to claim 23, note that Hashimoto in view of Ogawa in view of Roberts 
discloses all limitations except for a micro-lens layer. However, the use of micro-lens 
layers on image sensors is well known in the art to increase photosensitivity of the 
image sensor arrays, for example see Sano et al. (IEEE). Therefore, It would have 
been obvious to one of ordinary skill in the art at the time the invention was made to use 
a micro-lens layer with the imaging system of Hashimoto in view of Roberts to increase 
photosensitivity. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 
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A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Timothy J. Henn whose telephone number is (571) 272- 
7310. The examiner can normally be reached on M-F 11-7. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Lin Ye can be reached on (571) 272-7372. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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